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INTRODUCTION 

What  has  happened  to  survey  response  rates?  Why?  and  what  can  be 
done  about  It?  Social  scientists  are  currently  concerned  about  trends 
In  survey  response  rates  as  Illustrated  by  the  following  recent  state- 
aents: 


"Pollsters  are  Increasingly  concerned  about  the  grow- 
ing reluctance  of  the  public  to  be  Interviewed.  The  refusal 
rate  has  Increased.  It  costs  more  to  find  respondents.  The 
same  pattern  Is  evident  In  questionnaire  surveys."  (Llpset, 
1976). 


"There  Is  a pronounced  secular  decline  In  the  response 
rates  from  personal  Interviews:  It  Is  Increasingly  difficult 
to  maintain  response  rates  at  reasonable  levels,  and  despite 
Increased  effort  and  cost  designed  to  maintain  response  rates, 
the  decline  has  persisted."  (Juster,  1976). 


The  paper  Is  organized  to  explore  the  social  changes  hypothesized 
to  underlie  current  response  rate  problems,  to  examine  the  nature  of 
the  trends  based  on  data  furnished  by  major  survey  organizations,  and 
then  to  consider  possible  causes  of  the  observed  differences.  Atten- 
tion Is  focused  mainly  on  the  topic  of  in-person  Interviews . The  re- 
sponse rates  cited  here  are  computed  as  the  number  of  completed  Inter- 
views with  eligible  sample  units  divided  by  the  total  number  of  eligible 
sample  units.  Ballar  and  Lanphler  (1977)  provide  a discussion  of  cur- 
rent practices  In  defining  response  rates  and  Illustrate  possible  prob- 
lems with  actual  data  from  36  contemporary  survey  research  projects. 

The  definition  used  here  Is  the  approach  recommended  by  Ballar  and  Lan- 
phler. 


Prepared  as  a background  paper  for  a session  on  Response  Rates  at 
the  Biennial  Conference  on  Health  Survey  Research  Methods,  Williamsburg, 
Virginia,  May  1977.  The  author  extends  appreciation  to  the  many  persons 
and  organizations  who  have  furnished  data  for  the  paper.  Special  thanks 
are  due  to  Naomi  D.  Rothwell  of  the  Census  Bureau  who  out-performed  four 
automated  literature  searches  in  making  available  relevant  material. 
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HYPOTHESIZED  SOCIAL  CHANGE  CHARACTERISTICS  CAUSING  RESPONSE  RATES  TO 
DECLINE 

The  conventional  wisdom  asserts  that  survey  response  rates  have 
been  declining  over  recent  years  because  of  changes  In  society,  the  ef- 
fects of  which  the  survey  practitioner  can  neither  control  nor  overcome. 
The  categories  of  change  most  often  mentioned  are  of  three  types:  availa- 
bility, privacy,  and  physical  security. 

Availability 

Increasing  participation  In  activities  outside  the  home  makes  It 
difficult  to  locate  respondents  for  an  Interview.  For  example.  In  1960 
the  U.S.  labor  force  participation  rate  for  women  18-64  years  old  was 
42  percent.  By  1974  It  had  Increased  to  53  percent  (U.S.  Bureau  of  the 
Census,  1975,  based  on  Table  559).  This  trend  should  show  up  In  In- 
creasing noninterview  rates  over  time  (especially  the  not-at-home  com- 
ponent of  household  Interview  studies).  This  hypothesis  Is  examined  In 
the  next  section.  Contrary  to  expectations,  such  a trend  Is  not  found 
In  the  studies  examined. 

Privacy 

Persons  are  said  to  refuse  Interviews  because  their  answers  may  be 
misused.  Advances  In  data  handling  technology  make  the  personal  privacy 
Issue  a real  one.  It  Is  now  possible  to  create,  link,  and  access  large 
banks  of  Information  organized  by  Individual  Identifiers  such  as  the 
social  security  nuaber.  The  media  have  pointed  out  unsuspected  use  of 
stored  personal  Information  by  government  officials,  credit  bureaus, 
and  other  Institutions.  Recent  concern  has  focused  on  the  lack  of  safe- 
guards to  protect  medical  Information  In  data  banks  (e.g.,  Westln  (1976) 
and  the  1975  CHSS  Workshop  on  Privacy  and  Confidentiality). 

Concern  about  privacy  should  manifest  Itself  In  Increasing  survey 
refusal  rates.  Yet  the  available  refusal  rate  trend  data,  shown  In 
Tables  2-4  of  the  next  section,  suggest  little  or  no  Increase  In  the 
last  10-15  years. 
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If  privacy  concerns  are  increasing,  they  may  represent  future  prob- 
lems rather  than  adversely  affecting  past  survey  efforts.  The  Privacy 
Act  of  1974  and  emerging  state  legislation  now  require  many  of  us  to 
give  extra  Information  to  potential  respondents  about  the  voluntary 
nature  of  participation  and  the  potential  uses  of  volunteered  personal 
Information.  If  privacy  concerns  were  not  salient  to  the  public  before, 
these  required  statements  may  make  them  salient  now.  IVo  recently  com- 
pleted studies  have  addressed  privacy  Issues.  One  study,  conducted 
by  the  Bureau  of  the  Census,  experimentally  varied  what  the  respondent 
was  told  about  how  long  his  answers  would  remain  confidential  (forever, 
75  years,  25  years.  Immediately  released,  not  mentioned).  The  depend- 
ent variables  are  Interview  refusal  rates  before  and  after  the  Intro- 
ductory statement.  Eleanor  Singer  and  the  National  Opinion  Research 
Center  have  completed  a national  survey  In  which  Interview  and  Item  re- 
sponse rates  are  studied  In  relation  to  3 experimental  dimensions:  the 
amount  of  Information  given  to  a potential  respondent  about  the  survey, 
the  strength  of  the  assurance  of  confidentiality  (absolute,  "except  as 
required  by  law",  not  mentioned)  and  a request  that  the  respondent 
sign  a consent  form  (no  request,  request  before  Interview,  reqtiest  after 
Interview).  Results  of  the  studies  had  not  been  released  at  the  time 
this  paper  was  written. 

Physical  Security 

It  is  felt  that  the  Increase  In  crime  rates  affects  survey  response 
rates  In  at  least  two  ways:  directly  by  causing  reluctance  to  answer 
the  door  when  an  interviewer  calls  and  Indirectly  by  causing  people  to 
live  In  buildings  with  security  arrangements  that  exclude  both  Inter- 
viewers and  c ooks.  Trend  data  relevant  to  prevalence  of  security 
buildings  and  reluctance  to  answer  the  door  do  not  appear  to  exist. 

The  problem  of  nonfederal  inter.'lewer  access  to  buildings  with  guards 
does  exist.  For  the  SRC  economic  surveys,  Juster  (1976)  notes  a recent 

*Hy  thanks  to  Charles  Cowan,  U.S.  Bureau  of  the  Census,  Eleanor 
Singer  of  NORC,  and  Edwin  Goldfield  of  the  National  Academy  of  Sciences 
for  furnishing  Information  about  the  study  designs. 
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64  percent  response  rate  for  respondents  In  multi-unit  structures,  a 55 
percent  rate  for  residents  In  structures  with  more  than  9 units  and 
rates  between  39-55  percent  for  units  with  such  entry  barriers  as  "guard 
dogs,  locks  (and)  doormen."  Nevertheless,  the  data  In  the  next  section 
suggest  the  overall  nonrefusal  component  of  nonresponse  rates  has  not 
declined.  If  security  building  problems  are  Increasing,  It  appears  that 
other  availability  problems  may  be  decreasing. 

Other  Social  Chanse  Issues 


Other  hypothesized  changes  In  society  are  sometimes  mentioned  as 
causes  of  difficulties  obtaining  Interviews.  These  Include  the  Idea 
that  individuals  are  being  over  surveyed,  that  salespersons  posing  as 
Interviewers  are  Increasing,  and  respondent  attitudes  toward  surveys 
and  the  intended  uses  of  survey  data  may  be  changing. 

A collaborative  effort  between  the  Census  Bureau  and  Michigan's 
Survey  Research  Center  Includes  a detailed  Investigation  of  respondent 
experiences  with  surveys  along  with  their  knowledge,  opinions,  and  at- 
titudes about  surveys.  Some  of  the  questionnaire  Items  are  similar  to 
ones  used  In  earlier  NORC  and  SRC  surveys  so  time  trends  can  be  in- 
ferred. Until  these  results  are  available,  the  only  "hard"  data  avail- 
able come  from  a couple  of  recent  telephone  surveys  by  Walker  Research, 

* 

Inc.  (1975,  1976).  The  data  are  not  (unbiased)  national  population  es- 
timates . 

In  both  surveys  about  50  percent  said  they  had  been  Interviewed 
previously  In  the  last  12  months  (half  of  these  by  phone,  25  percent  by 
mall  and  the  remainder  In  the  home  or  at  a shopping  center) . Forty  percent 


Telephone  Interviews  were  completed  with  ten  household  heads  (pre- 
dominantly female)  In  each  of  30  metropolitan  market  areas  In  1974  and 
again  In  1976  with  a different  sas|>le.  Residential  telephone  nuinbers 
were  selected  from  directories  covering  each  SMSA.  A "one"  was  added  to 
the  last  digit  of  each  selected  telephone  number  to  determine  the  number 
to  be  called.  A quota  sample  of  10  completed  Interviews  per  market  area 
was  obtained.  Details  of  the  quota  criteria  and  the  response  rates  are 
not  furnished. 
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said  they  had  experienced  a sales  pitch  disguised  as  a survey  and  this 
group  had  slightly  less  favorable  attitudes  toward  surveys. 

Answers  to  questions  about  privacy  and  exploitation  (along  with 
the  questions  and  response  distributions  eliciting  the  most  and  least 
favorable  replies)  are  shown  In  Table  1. 

Table  1 

Percentage  Agreement  to  Selected  Survey  Image  Statements: 

1974,  1976 


STATEMENT 


PERCENT  AGREE  (STRONGLY,  SOMEWHAT) 
1974  1976 


The  research  Industry  serves 
a useful  purpose 


The  Information  obtained  In 
polls  or  research  surveys  helps 
amnufacturers  sell  consumers 
products  they  don't  want  or 
need 


Polls  or  research  surveys  are 
an  Invasion  of  privacy 


Answering  questions  In  polls 
or  research  surveys  is  a waste 
of  time 


(Source:  Walker  Research,  Inc.,  1975,  1976). 
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For  those  who  believe  there  Is  a causal  link  between  prior  attitudes 
and  behavior,  these  results  are  cause  for  concern.  Response  rates  (be- 
havior) can  be  expected  to  suffer  if  half  the  telephone-owning  households 
in  a market  area  have  been  interviewed  in  the  last  year  and  at  least  20 
percent  of  all  respondents  have  unfavorable  attitudes  about  surveys.  Fo]>* 
tunately,  perhaps,  the  link  between  responses  to  attitude  survey  questions 
and  behavior  is  not  well  established. 

In  the  next  section,  the  other  part  of  the  conventional  wisdom  is  ex- 
amined: Have  response  rates  declined  over  the  years  and  where  are  they 
now? 

TIME  TRENDS  FOR  IN-PERSON  RESPONSE  RATES 

In  this  section,  response  and  refusal  rates  for  national  studies 
conducted  by  federal  and  university-based  survey  organizations  are  ex- 
amined. The  data  do  not  support  the  convention  wisdom:  while  respoi.se 
rates  in  the  1950' s may  have  been  higher  than  they  are  now,  there  is  no 
definitive  declining  trend  over  the  past  10-15  years.  There  are  differ- 
ences between  organizations  which  have  persisted  over  time  and  the  under- 
standing of  these  differences  may  shed  more  light  on  determinants  of  re- 
sponse rates  than  the  previous  discussion  of  changes  in  society. 

One-time,  In-person,  Population  Surveys 

( 

’ Trends  in  overall  response  rates  and  refusal  rates  for  selected  stu- 

dies may  be  seen  in  Table  2.  The  Health  Interview  Survey  employs  a na- 

t tional  sample  of  35-40  thousand  households  per  year.  The  fieldwork  is 

i 

idone  by  the  Census  Bureau  and  each  unit  is  interviewed  once.  One  adult 
may  respond  for  all  household  members  although  self-response  is  encour- 
aged when  possible.  Interviews  cover  health  problems  and  use  of  health 
services,  lasting  from  30  minutes  to  over  an  hour.  The  Michigan  Economic 
Surveys  are  conducted  periodically  by  the  Survey  Research  Center  (SRC)  at 
Michigan.  The  sample  sizes  range  between  1,500  and  2,500  households  in 
the  coterminous  United  States.  The  average  length  of  the  interview  has 


Table  2 


Response*^  and  Refusal 


Rat^ 


Ranges  For  One-tine,  In-Person 


Interview  Studies:  1955-present 


HEALTH  MICHIGAN  , SELECTED 

INTERVIEW  SURVET^  ECONOMIC  SURVEYS®  NATIONAL  STUDIES® 


YEAR 

Response 

Refusal 

Response 

Refusal 

Response 

Refusal 

1955-1959 

83-88 

5-8 

1960-1964 

95-96 

Not 

Available 

79-85 

6-12 

76-8? 

13-17 

1965-1969 

95-96 

1.2-1. 3 

78-83 

9-14 

75-76 

15-18 

1970-1974 

96-97 

1.1-1. 5 

78-81^ 

(72-76)+5 

12-14 

14-16 

74-82 

14-17 

1975-^ 

97 

1.4 

(72-74)+5 

15-16 

h 

®The 

response  rate 

Is  the  nuinber 

of  completed 

Interviews 

per  100  eligible  house- 

holds  (or  other  saiiq>llng  units)  . 

^The  refusal  rate  is  only  one  component  of  the  overall  noninterview  rate  for  eli- 
gible units.  Other  components  (which  include  no  one  home,  seasonal  absence,  language 
barrier,  mental  or  physical  problems  precluding  interview,  etc.  are  omitted).  The 
Health  Interview  Survey  refusal  rate  is  shown  to  one  decimal  place  because  rounding 
error  would  have  obscured  what  some  have  seen  as  a trend  toward  increasing  refusal 
rates  over  time. 

®1968-1975  data  adapted  from  Love  and  Turner  (1975).  1960-1965  estimates  derived 

from  average  noninterview  rates  per  Interviewer  (Koons,  1973)  assuming  no  correlation 
between  an  Interviewer's  total  assignment  size  and  her  noninterview  rate.  Estimates 
for  1966-67  are  not  Included. 

‘^ata  adapted  from  Scott  (1971  and  1976). 

Data  courtesy  of  Martin  Frankel,  technical  director,  NORC. 

f 

‘'Recent  data  are  provisional  and  not  always  for  complete  calendar  years. 

^First  range  Is  for  1970-1971.  Thereafter,  a different  respondent  selection 
and  Interviewing  procedure  was  instituted  causing  an  Immediate  5 percent  drop  In 
response  rates.  (Juster,  1976,  Fig.  1). 

^Person  response  rates  (Z  rates)  for  the  1976  medical  access  study.  Involving 
all  4 saiig>les  of  between  1200-4700  households  each  ranged  from  82  to  98  percent  (M. 
Frankel,  personal  communication). 
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ranged  over  the  years  from  45  minutes  to  an  hour-and-a  half.  Before  1972, 
the  respondent  was  the  head  of  the  household.  Specific  persons  are  cur- 
rently designated  as  respondents . The  National  Opinion  Research  Center  | 

(NORC)  data  are  from  selected  national  studies  with  Interview  lengths  * 

from  1 to  2-1/2  hours.  Subject  matter  of  the  Interviews  varies  from  study 

i 

to  study  as  do  the  respondent  rules.  \ 

The  data,  taken  as  a whole,  do  not  Indicate  uniform  trends  toward 
massive  respondent  non cooperation  over  time.  The  overall  response  rates 
for  the  Health  Interview  Survey  are  high,  stable,  and  possibly  getting 
better  over  the  15  year  period  shown.  The  data  from  the  University-based 
organizations  suggest  that  during  most  of  the  past  10  years,  response 
rates  were  in  the  70's-to-low  80's  with  the  SRC  economic  surveys  getting 
higher  rates  15  to  20  years  ago  compared  to  recent  years.  The  decline  In 
SRC  rates  beginning  in  the  early  70' s Is  attributed  to  a change  in  respond- 
ent rules.  The  SRC  refusal  rates  exhibit  a possible  Increasing  trend  over 
time  and  a similar  trend  could  be  occurring  in  the  Health  Interview  Survey. 

As  footnote  h points  out,  a recent  large-scale  NORC  national  survey  of  ac- 
cess to  medical  care  achieved  response  rates  In  the  80 's  or  90' s.  Indicat- 
ing that  such  rates  are  still  possible  to  achieve  currently  by  nonfederal 
organizations  for  national  samples. 

Trend  data  were  not  readily  available  from  the  large  number  of  pri- 
vate organizations  who  conduct  survey  research  and  polls.  These  organiza- 
tions claim  to  be  experiencing  problems  as  the  following  excerpt  from  the 
1973  Conference  on  Surveys  of  Human  Populations  (American  Statistical  As- 
sociation, 1974)  shows: 

"...spokesmen  for  a number  of  private  survey  organiza- 
tions, large  and  small,  who  were  queried  by  one  of  the  con- 
ference participants,  all  report  that  their  completion  rates 
on  general  population  samples  now  average  approximately  60 
to  65  percent.  In  spite  of  three  or  four  callbacks.  This  re- 
cent experience  Is  In  contrast  to  a completion  figure  of  80 
to  85  percent  for  the  same  firms  In  the  decade  of  the  sixties." 
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Public  disclosure  of  detailed  response  rate  data  from  private  organi- 
zations might  aid  in  reconciling  the  apparent  differences  between  such 
claims  and  Inferences  drawn  from  the  federal  and  university-based  organi- 
zation experiences. 

Repeated  Interview  Surveys 

Possibly  major  declines  in  response  rates  can  be  found  in  the  short 
term  panel  surveys  which  seek  continued  respondent  cooperation.  Time 
trends  in  response  rates  for  three  studies  of  this  type,  all  conducted 
^y  the  Bureau  of  the  Census,  are  examined  next.  The  data  indicate  the 
Census  Bureau  has  been  able  to  maintain  very  high  response  rates  over  the 
years  but  may  be  experiencing  a slight  contemporary  Increase  in  refusals. 

The  Current  Population  Survey  has  a current  annual  sample  size  of 
48,000  households.  A household  respondent  is  interviewed  about  labor 
force  and  other  data  monthly  for  four  months,  not  interviewed  for  eight 
months,  and  Interviewed  again  monthly  for  another  four  months.  In-person 
interviews  are  attempted  during  a designated  three  of  the  eight  interview 
months.  Telephone  interviews  may  be  substituted  during  the  other  months. 
The  Current  Population  Survey  has  maintained  consistently  high  response 
rates  and  low  refusal  rates  for  the  last  10  years  as  shown  in  Table  3. 

If  there  are  any  trends,  they  are  for  the  overall  response  rates  to  be 
increasing  slightly  over  time  and  possibly  for  refusal  rates  to  be  in- 
creasing slightly.  This  implies  that  If  refusals  have  increased,  there 
is  a more  than  compensating  decreasing  trend  in  the  other  components  of 
nonresponse . 

The  Current  Medicare  Survey  is  also  a short  term  panel  study  conduc- 
ted by  the  Census  Bureau.  It  involves  15  monthly  personal  (in-person  or 
telephone)  interviews  which  last  about  10  minutes  with  6,000  Medicare  en- 
rollees.  Respondents  report  expenditures  for  medical  goods  and  services 
incurred  over  the  preceding  month.  According  to  Greene  (1976)  average  re- 
sponse rates  over  entire  panel  periods  (15  months  each)  have  averaged 

* 

about  97  percent  in  1974,  1975,  and  1976. 

* 

Jack  Scharff,  n.S.  Health  Care  Financing  Agency,  recently  compiled 
CMS  trend  data  for  a longer  time  period.  His  preliminary  analysis  indi- 
cates that  the  average  refusal  rate  in  the  CMS  aged  sample  has  increased 
from  about  1-1/2  percent  to  about  3 percent  since  1969-70.  The  trend  in 
refusals  may  be  in  the  opposite  direction  for  the  disabled  sample. 


L 
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Table  3 

Response  and  Refusal  Rates  Ranges  for  the  Current  Population 

Survey:  1965-Present^ 


Year 

„ 2 

Response 

Refusal^ 

1965-1969 

95-95 

1.2-1. 3 

1970-1974 

96-96 

1.1-1. 5 

1975-1976 

97 

1.4 

1965-1974  data  adapted  from  Love  and  Turner  (1975)  with  1975  and 
the  first  11  months  of  1976  data  from  "Current  Population  Survey  Sample 
Size  and  Noninterview  Rates — November  1976"  compiled  by  the  Reinterview 
Design  and  Analysis  Section,  Statistical  Methods  Division,  U.S.  Bureau 
of  the  Census,  8 December  1976. 

2 

These  are  average  rates  over  all  interviewing  waves.  Within  re- 
cent panels,  there  is  a tendency  for  refusals  to  increase  in  later  waves 
and  other  nonresponse  components  (e.g.,  not-at-home)  to  decrease. 


Table  4 

Response  and  Refusal  Rates  for  the  Interview  Component  of  the 
1972-73  Consumer  Expenditures  Survey  by  Year  and  Wave 


Response 

Rates 

Refusal 

Rates 

Wave 

1972 

1973 

1972 

1973 

1 

95 

94 

3.3 

4.4 

2 

91 

90 

6.9 

7.6 

3 

88 

89 

8.6 

9.1 

4 

88 

89 

10.0 

9.9 

5 

88 

89 

10.8 

10.0 

(Source:  Greene,  1976). 
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Quarterly  Consuiner  Expenditure  Panels  were  conducted  with  a sample 
of  11,000  households  In  1972-73  by  the  Census  Bureau.  For  the  Interview 
component,  households  engaged  In  Interviews  lasting  2-3  hours  In  each  for 
five  consecutive  quarters.  Although  not  able  to  maintain  response  rates 
over  95  percent  as  In  Its  other  studies,  the  Census  Bureau  was  able  to 
maintain  a very  liiq>re8slve  level  of  cooperation  throughout  all  waves. 
These  data  (reproduced  from  Greene,  1976)  are  In  Table  4. 

Nonavailability 

To  complete  the  picture,  trends  In  the  nonavailability  coiq>onent  of 
nonresponse  are  shown  In  Table  5.  The  numbers  are  the  difference  between 
the  total  nonresponse  rate  and  the  refusal  rate  shown  In  previous  tables. 
The  largest  component  of  this  residual  are  elements  classified  variously 
as  not-at-home,  unable  to  contact,  or  respondent  absent. 

These  rates  also  fall  to  show  large  changes  over  time.  The  studies 
In  which  the  Census  Bureau  or  NORC  did  the  fieldwork  do  not  show  Increas- 
ing availability  problems.  The  SRC  data  do  Indicate  a recent  Increase 
but  this  may  be  due  to  the  change  in  respondent  rule. 

The  lack  of  trends  may  only  reflect  successful  efforts  made  by  these 
organizations  to  overcome  availability  problems,  for  example,  by  Increas- 
ing the  nuid>er  of  calls  made  per  completed  Interview.  Call  data  are  not 
generally  available  to  the  research  community  (they  are  Internal  organi- 
zational Information  not  necessary  to  the  Interpretation  of  published 
survey  results)  so  It  Is  not  possible  to  test  the  hypothesis.  However, 
Juster  (1976)  notes  that  the  number  of  contacts  per  household  In  a 1973 
SRC  economic  study  was  considerably  lower  than  In  a 1976  study. 

Urban  Area  Response  Rates 

Survey  response  rates  are  often  said  to  be  lower  In  urban  areas  than 
In  smaller  or  less  densely  populated  areas.  Available  data  lend  only 
equivocal  support  to  this  hypothesis. 

Scott's  (1971,  1976)  data  for  the  SRC  Economic  Surveys  (see  Table 
6)  show  that  response  rates  are  lower  and  have  declined  more  rapidly  In 
the  large,  self-representing  SMSAs  than  In  other  areas.  The  recent 
(1975-76)  rates  have  been  especially  low,  close  to  those  mentioned  for 
private  organizations  at  the  ASA  Conference  on  Surveys  of  Human 
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Table  5 

of  Nonresponse  Rates  Exclusive  of  Refusals'^  from  Selected  Surveys  by  Year 
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Populations  (American  Statistical  Association,  1974).  However,  at  least 
part  of  the  reason  for  low  contemporary  rates  is  due  to  a shift  to  more 
demanding  respondent  rules. 

Recent  Census  Bureau  experience  (Table  7)  comparing  rates  obtained 
in  separate  urban  area  studies  with  national  rates  for  the  Annual  Housing 
Survey  and  The  National  Crime  Survey  do  not  exhibit  the  expected  discrep- 
ency.  As  the  source  articles  point  out,  the  SMSA  sample  field  periods  are 
considerably  longer  than  those  for  national  sample  assignments , providing 
extra  time  to  locate  respondents  and  convert  refusals.  Walsh's  (1976)  an- 
alysis of  expenditure  diary  response  rates  (Table  8)  shows  the  central 
city  and  SMSA  rates  to  be  lower  than  for  other  areas  in  1972  but  the  dif- 
ferences narrowed  appreciably  in  the  following  year.  As  a whole  these 
data  suggest  that  urban  area  response  rates  can  present  problems,  but  ones 
that  at  least  the  Census  Bureau  has  been  able  to  overcome. 

Finally,  Eve  Fielder  at  UCLA  was  kind  enough  to  provide  response 
rate  data  for  the  Los  Angeles  Metropolitan  Area  Survey  which  has  conduc- 
ted 11  urban  area  studies  since  1970.  There  is  a good  deal  of  variance 
in  the  overall  nonresponse  rates  and  all  eleven  points  to  not  produce  a 
linear  time  trend  significantly  different  from  zero.  The  refusal  rates, 
on  the  other  hand,  do  exhibit  a statistically  significant  Increase  over 
time  averaging  3/4  of  1 percent  per  year. 


CONCLUSIONS  ABOUT  TIME  TRENDS  IN  RESPONSE  RATES 

The  available  data  do  not  show  a major  decline  in  response  rates 
over  the  past  10-15  years.  The  conclusion  to  be  drawn,  however,  is  not 
that  high  response  rates  are  as  easy  to  achieve  now  as  in  the  past.  This 
kind  of  conclusion  would  require  an  analysis  of  cost  data  or  other  indi- 
cators of  field  effort  and  these  data  are  not  generally  available.  Also 
response  rate  data  from  a more  representative  sample  of  survey  studies 
would  be  required. 
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The  available  data  are  sufficient  to  suggest  two  things: 

1.  Response  rates  even  in  urban  areas  are  still  under  the  poten- 
tial control  of  the  field  designer.  The  changes  in  society 
vhlch  have  taken  place  have  not  doomed  survey  research  to  fall* 
ure  in  the  future. 

2.  High  contemporary  response  rates  can  be  achieved,  at  least  by 
some  organizations,  if  sufficient  resources  and  design  skill 
are  applied  to  the  task. 

In  the  next  section,  variables  other  than  changes  in  society  which 
may  affect  response  rates  are  considered. 
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Table  6 

Average  Response  Rates  for  Michigan 
Economic  Surveys  by  Large  SMSA  and  Other  Areas: 
1%0-1976 


YEAR 


LARGE  SMSA 


OTHER  AREAS 


1%0-1964 

1965-1969 

1970-1974 

1975-1976 


75 

82 

74 

83 

71 

79 

61 

78 

Source:  Adapted  from  Scott  (1971,  1976). 


Table  7 

National  Sample  and  Urban  Sample  Average  Response  Rates 


For 

the  Annual  Housing  Survey  and  National 

ANNUAL  HOUSING  SURVEY 

(local)  Crime  Survey 

CRIME  SURVEY 

SMSA  Studies  National  Sample  Urban 

Area  Studies 

National  Sample 

YEAR 

(longitudinal) 

(Panels) 

1972 

95 

95 

1973 

97 

95 

96 

1974 

96  97 

97 

96 

1975 

96 

96 

Source:  Adapted  from  Love  and  Turner  (1976)  and  Greene  (1976) . 


Table  8 

Response  Rates  for  the  Diary  Component  of  the  National  Consumer  Expenditures 

Survey  by  Type  of  Place 

FISCAL  Central  City  Other 

YEA^  Within  SMSA  SMSA 

75  81 

88  89 


Not  SMSA 
32 
92 


1972 

1973 


Source : 


Walsh  (1976,  Table  3) 
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CAUSES  AND  CX)RBELATES  OF  RESPONSE  RATES  FOR  IN-PERSON  INTERVIEWS 

If  there  isn't  a universal  decline  In  survey  response  rates  we  should 
turn  our  attention  away  from  external  causes  toward  variables  under  the 
control  of  the  survey  designer.  Some  recent  literature  Is  reviewed 
briefly  In  this  section  followed  by  a discussion  of  other  things  that  may 
account  for  observed  variation  In  response  rates  among  organizations. 

Auspices 

Since  the  Census  Bureau  Is  relatively  more  successful  than  other 
survey  organizations,  one  wonders  If  there  Is  some  magic  In  the  name  which 
overcomes  nonresponse  problems.  As  Love  and  Turner  (1975)  point  out,  the 
Bureau  has  a strong  "brand  name",  citizens  may  feel  an  obligation  to  co- 
operate with  their  government,  and  the  uses  of  census  data,  such  as  es- 
timates of  the  unemployment  rate,  are  well  known.  The  name  of  the  data 
collecting  agency  cannot  affect  not-at-home  rates  but  It  can  convert  po- 
tential refusals  and  chronically  broken  appointments. 

Sudman  and  Ferber  (1974)  split  their  sample  of  Chicago  area  house- 
holds Into  those  approached  In  the  name  of  the  Census  Bureau  and  those 
approached  In  the  name  of  the  Illinois  Survey  Research  Laboratory.  Re- 
spondents were  asked  to  grant  an  Initial  Interview  and  to  report  house- 
hold expenditures  for  two  weeks  either  by  telephone  or  using  a diary. 
Initial  Intei^lew  response  rates  were  low  (around  60  percent)  with  the 
Bureau  auspices  producing  nonslgnlflcantly  more  cooperation  In  the  sub- 
urban sample.  Full  or  partial  cooperation  In  reporting  expenditures 
over  the  next  two  weeks  showed  similar,  nonsignificant  trends. 

The  effect  of  auspices  has  been  tested  again  In  a Joint  Census-SRC 
study  of  confidentiality  and  attitudes.  Each  organization  was  assigned 
half  of  each  cluster  of  households  for  Interviewing.  Results  are  to  be 
available  in  the  1977  Proceedings  of  the  Social  Statistics  Section,  Am- 
erican Statistical  Association. 

Seasonality 

Available  data  Indicate  that  nonresponse  rates  (or  the  not  available 
component)  Increase  slightly  during  the  summer.  Scott  (1971)  examined 
29  economic  surveys  over  a 15  year  period  and  found  summer  nonresponse 
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rates  about  6/10  of  one  percent  above  spring  and  fall  rates 
on  the  average.  Interviewer  nonresponse  rates  on  the  Health  Inter- 
view Survey  (Koons,  1973)  were  uniformly  higher  during  the  summer 
quarter  (July-September)  for  the  years  examined  (1958-1964) . The  Cur- 
rent Population  Survey  temporarily  absent  component  of  nonresponse 
averaged  1.2  percent  In  June  - August  1976  compared  to  about  0.6  per- 
cent In  other  months  of  1976.  For  most  purposes,  the  magnitude  of  the 
summer  seasonality  bias  would  not  appear  great  enough  to  warrant  spe- 
cial concern.  Palmer  (unpublished),  however,  shows  that  the  seasonal 
Increase  In  CPS  nonresponse  and  the  1965  nonresponse  Imputation  pro- 
cedures results  In  a statistically  significant  bias  In  published  esti- 
mates of  the  labor  force  category  "with  a job,  not  at  work." 


Callbacks 

It  is  worth  remembering  that  effort  In  the  field  Is  positively 
correlated  with  response  rates.  Sudman  (1967)  and  Kish  (1965)  show 
the  productivity  of  each  additional  callback  on  response  rates  for  the 
1950's  and  1960's.  Scott  (1976)  shows  that  the  marginal  productivity 
of  callbacks  has  not  changed  In  SRC  economic  studies  in  the  1973-76 
period,  e.g.,  the  third  callback  (4th  call)  yields  a 62-66  percent 
Interview  rate.  Health  Interview  Survey  data  Indicate  the  4th  call 
yields  a 91  percent  rate.  After  the  second  call  the  response  rate  Is 
74  percent.  (Sprately,  1975).  Scott's  (1971)  data  Indicate  that 
limiting  callbacks  to  three  In  1961  reduced  response  rates  at  least 
5-8  percent  compared  to  rates  achieved  In  similar  studies  without 
the  restriction  In  adjacent  years.  Within  the  pid>lished  ranges.  It 
Is  clear  that  Increasing  callbacks  results  In  Increasing  the  nun^er 
of  completed  Interviews  with  eligible  sample  units.  (This  Is  one  of 
the  few  causal  relationships  we  "know  for  sure"  In  survey  design) . The 
Census  Bureau's  recent  paper  on  best  times  to  call  (Weber,  1973)  should 
help  Increase  the  efficiency  of  calls  In  the  field  for  a variety  of 
studies  using  different  respondent  rules. 
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The  effectiveness  of  a callback  at  the  margin  may  also  depend  on 
the  definition  of  a call  (e.g.,  a visit  while  the  interviewer  is  in 
the  neighborhood  vs.  a deliberate  attempt  at  a different  time  and 
day),  the  length  of  the  field  period,  the  interviewer's  workload, 
and  the  amount  of  clustering  in  the  sample.  Within  the  total  survey 
design  context,  it  is  theoretically  possible  to  set  the  number  of  calls 
to  be  made  per  unit,  cluster  size,  length  of  field  period,  number  of 
interviews,  and  size  of  assignments  so  as  to  optimize  costs  and  the 
resulting  magnitude  of  nonresponse  bias  affecting  Inferences  from  the 
data. 

Interview  Length  and  Other  Burdens 

Interview  length  may  have  some  effects  on  response  rates,  espe- 
cially if  length  is  very  short  or  very  long.  NORC  data,  furnished  by 
Prankel,  Include  two,  20-mlnute  national  sample  studies  conducted  in 
1962  and  1966.  Response  rates  were  90  and  84  percent  compared  to  rates 
closer  to  75  percent  for  studies  using  interviews  lasting  an  hour  or 
more  in  similar  years.  The  SRC  economic  studies  contain  a narrower 
range  of  variation  in  average  interview  length  (45-90  minutes) . Scott 
(1971)  reports  the  correlation  between  response  rate  and  length  to  be 
zero  or  "slight"  depending  upon  assumptions  used  to  correct  for  secular 
time  trends.  The  studies  conducted  by  the  Census  Bureau  cited  earlier 
range  from  a few  minutes  to  several  hours  in  average  interview  length. 
Response  rates  drop  to  90  percent  only  for  the  extremely  long  inter- 
views but  this  may  be  due  to  the  subject  matter  (expenditures) . Dill- 
man  (1977)  shows  mall  rates  drop  if  length  exceeds  12  pages. 

The  Market  Research  Society  in  Great  Britain  (MRS,  1976)  points 
out  that  sources  of  burden  (on  both  interviewers  and  respondents) 
other  than  interview  length  have  increased  over  time.  Examples  cited 
include  use  of  batteries  of  "semantic  scales"  and  intricate  question- 
naire designs  to  meet  optical  scanning  processing  requirements.  Such 
effects  are  seen  as  indirectly  affecting  response  rates  by  interfer- 
ing with  rapport  and  causing  respondents  to  be  more  reluctant  to  par- 
ticipate in  future  surveys. 
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The  Walker  Research,  lac.  study  (1975,  1976)  Indicates  a minority 
of  previously  surveyed  respondents  report  dissatisfaction  with  length 
(17-25  percent),  overly  personal  questions  (16-19  percent)  or  overly 
difficult  questions  (8-9  percent).  Dissatisfaction  with  length  was 
clearly  related  to  perceived  (recalled)  length.  Almost  half  of  those 
who  were  interviewed  for  11-20  minutes  objected  to  the  length  and  63 
percent  of  those  interviewed  for  more  than  20  minutes  felt  the  survey 
was  too  long.  It  would  be  unwise  to  conclude,  however,  that  interview 

length  Influences  response  rates  via  respondent  attitudes.  If  length  j 

affects  interview  rates,  it  is  probably  because  of  the  Indirect  effects 
on  interviewer  workload  and  constraints  on  the  ability  to  schedule  in- 
terviews . 

Advance  Letters,  Brochures,  Prior  Appointments 

The  Census  Bureau  has  prepared  a recent  bibliography  on  this  sub- 
ject for  those  who  wish  to  pursue  the  topic  further.  (Survey  Method- 
ology Information  System,  Undated-a) . My  interpretation  of  the  liter- 
ature is  that  effects  of  activities  prior  to  the  at-the-door  contact 
are  equivocal.  The  advance  material  does  provide  information  to  the 
respondent  upon  which  he  may  base  his  cooperation  decision.  This  is 
fine  if  the  decision  to  respond  is  positive  but  the  other  outcome  is 
not  unlikely  and  the  reluctance  encountered  at  the  door  is  now  much 
firmer  than  it  might  have  been.  Advance  material  and  appointments  can 
reduce  interviewer  travel  and  salary  costs,  possibly  enough  to  warrant 
a lower  overall  response  rate.  The  use  of  advance  contact  is  cer- 
tainly a dimension  to  be  considered  in  the  total  survey  design. 

Incentives 

Paying  respondents  to  cooperate  was  discussed  at  the  last  confer- 
ence (HCHSR  and  MCHS,  1975,  pp. 16-17).  At  this  point,  a simple  general- 
ization about  the  effects  of  compensation  on  response  rates  isn’t 
possible.  The  literature  Indicates  Incentives  do  Increase  response 
rates  in  mall  surveys  but  the  upper  ranges  (payments  or  gifts  over 
$1  haven’t  been  tested  adequately).  The  Improvements  noted  are  in- 
creasing otherwise  low  return  rates  to  moderate  levels,  (Kanuk  and 
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Berenson,  1975).  Payments  appear  Co  Induce  more  people  to  take  a health 
examination  although  apparently  they  aren't  large  enough  to  overcome  Che 
fear  of  embarrassment  which  some  women  experience  (Bryant  et  al.,  1973). 
Compensation  may  help  sustain  cooperation  in  diary  panel  studies  lasting 
more  chan  two  weeks  (Ferber  and  Sudman,  1974).  Payments  are  not  cost  ef- 
fective in  shorter  diary  panels  (Walsh,  1976).  The  use  of  monetary  in- 
centives to  Increase  response  rates  for  in-person  interviews  has  received 
little  experimental  attention.  Dohrenwend  (1971)  reports  no  effect  on  a 
$5  honorarium  on  initial  and  repeat  interview  response-  rates  in  an  urban 
area.  On  the  other  hand,  Chromy  and  Horvitz  (1974)  show  that  a $5  to  $20 
payment  can  motivate  more  young  adults  in  a national  household  survey  to 
complete  knowledge  tests  compared  to  a no-lncentlve  condition.  The  latter 
research  indicates  that  varying  the  amount  paid  by  the  number  of  test  pack- 
ages completed  by  the  respondent  is  cost  effective.  This  condition  has 
been  adopted  in  succeeding  surveys. 

More  information  about  incentives  may  be  obtained  by  consulting  the 
Census  Bureau  bibliography  (Survey  Methodology  Information  Service,  Undated- 
b) , and  Ferber  and  Sudman  (1974) . 

Interviewers 

Some  interviewers  are  more  successful  than  others  at  getting  comple- 
ted interviews.  Barbara  Ballar  has  done  extensive  work  in  this  area.  Her 
report  (Ballar  and  Lanphler,  1977)  comments  on  the  Important  amount  of 
variance  in  response  rates  contributed  by  interviewers.  For  a review  of 
eiqplrlcal  studies,  see  Inderfurth  (1972). 


Respondent  Rules 

In  many  surveys  it  is  possible  to  consider  accepting  responses  from 
informants  about  sample  person  characteristics  as  a method  of  reducing 
costs  and  nonresponse.  Kovar  and  Wright  (1973)  report  the  results  of  the 
Health  Interview  Study  experiment  requiring  100  percent  self  response. 

For  the  experiment,  interviewers  were  asked  to  contact  households  initi- 
ally at  usual  times.  There  was  a possible  slight  variation  in  initial 
time  of  call  (22  percent  after  6 p.m.  to  self- responding  households  vs. 

19  percent  to  other  units)  but  it  produced  74  percent  of  adults  at  home 
on  the  initial  call  (vs.  63  percent  in  the  household  respondent  treatment). 
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In  both  groups  the  household  response  rate  was  the  sane  96  percent.  The 
person  response  rate  (Z-rate)  dropped  from 99. 8 percent  to  98.7  percent  In 
the  self  response  treatment.  96  percent  of  the  adults  responded  for  them- 
selves In  the  condition  requiring  it  whereas  67  percent  self  responded  when 
it  was  not  required.  Costs  increased  17  percent  (probably  an  upper  bound 
estlBiate  since  interviewers  were  not  allowed  flexibility  in  timing  initial 
calls).  When  SRC  switched  its  respondent  designation  procedures,  response 
rates  declined.  Juster  (1976)  notes  a 5 percent  reduction  when  the  designa- 
ted respondent  was  changed  from  the  household  head  (or  spouse  if  necessary) 
to  a specifically  selected  household  member  over  age  17  (with  proxy  re-  ] 

sponses  not  permitted).  In  Census  Bureau  studies  requiring  self-  | 

respondents,  the  effect  on  response  rates  is  to  decrease  them  1-2  percent 
(see  for  example.  Love  and  Turner's  discussion  of  the  National  Crime  Sur- 
vey, 1976).  The  difference  between  household  response  rates  and  the  over- 
all person  response  rates  in  the  recent  NORC  medical  access  study  ranged  ^ 

from  2 to  6 percent  (M.  Frankel,  personal  communication). 

Organizational  Features  and  Quality  Control 

The  most  parsimonious  hypothesis  accounting  for  differences  in  re- 
sponse rates  is  that  some  organizations  structure  field  activities  more 
effectively  than  others.  If  society  has  changed,  these  organizations 
have  been  able  to  adapt  without  a great  change  in  efficiency.  It  is  well 
beyond  the  scope  of  this  paper  to  present  comparative  management  analy- 
ses of  the  various  organizations  and  projects  kind  enough  to  furnish  re- 
sponse rate  problems  and  some  key  organization  features  which  may  differ 
from  the  norm  for  nonfederal  survey  groups. 

A major  feature  is  that  the  bulk  of  Census  Bureau  sample  research 
is  with  continuous,  large  scale  studies.  With  ongoing  programs  it  is 
possible  to  identify  problems,  try  out  alternative  solutions,  and  imple- 
ment them  directly.  Continuous  studies  enable  the  organization  to  main- 
tain a large,  permanent  field  staff  who  become  experts  in  one 
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particular  kind  of  Interview.  Expertise  cumulates  so  that  successful 
procedures  can  be  taught  to  the  entire  staff  In  refresher  training 
sessions.  Organizations  serving  the  one-time,  customized  survey  mar- 
ket (often  not  requiring  national  samples  or  requiring  more  staff  In 
one  of  the  PSU's  than  Is  normally  available)  are  less  able  to  maintain 
a large,  permanent  field  staff  and  find  It  difficult  to  correct  prob- 
lems during  short  field  periods.  Studies  are  different  enough  so  that 
It  Is  not  always  possible  to  generalize  effective  procedures  from  one 
to  another. 

Noninterview  Standards  and  Quality  Control.  The  Census  Bureau 
sets  very  high  standards  for  response  rates  and  features  these  require- 
ments prominently  In  training  sessions  and  quarterly  reviews  of  Indi- 
vidual Interviewer  performance.  Performance  reviews  are  based  on  ob- 
servations of  fieldwork,  results  of  relntervlews,  and  a tabulation  of 
questionnaire  entry  error  rates  (Greene,  1976).  Interviewer  produc- 
tivity (and  other  performance)  is  rewarded  by  cash  awards,  promotion, 
salary  Increases  and  (If  not  full  time)  additional  work  opportunities. 
Poor  performance  results  both  In  additional  monitoring  and  being  placed 
on  probation.  Probation  tine  does  not  count  toward  wlthln-grade  tenure 
needed  for  automatic  salary  Increases  (Green  1976). 

* 

Work  Facilitation  by  the  Organization.  Periodic  refresher  train- 
ing sessions  are  held  to  discuss  reasons  given  by  reluctant  respondents 
and  methods  of  responding  to  them.  This  procedure,  of  course.  Is  maxi- 
mally effective  In  continuous  studies.  The  Bureau  has  the  advantage 
of  accumulated  experience  with  ongoing  surveys  and  can  set  (and  en- 
force) realistic  assignment  sizes  and  completion  deadlines  for  each 
sample  area.  It  Is  not  as  easy  to  do  this  for  one-time  special  studies 
whose  field  requirements  and  problems  vary  across  surveys.  The  Bureau 
provides  Interviewers  with  Information  on  the  best  times  to  make  Ini- 
tial calls  to  locate  particular  kinds  of  respondents.  On  some  studies, 

the  Interviewer  Is  required  to  contact  the  entire  assignment  early  In 

_ 

Discussion  based  on  Greene,  1976;  Love  and  Turner,  1975;  and 
Walsh,  1976. 
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the  field  period.  For  most  studies,  the  office  Is  notified  of  poten- 
tial refusals  and  takes  specific  steps  to  persuade  the  respondent  to 
cooperate  %rhen  the  Interviewer  calls  again.  Donny  Rothwell  (personal 
communication)  points  out  that  the  local  office  can  Invoke  a law  pro- 
hibiting doormen  (etc.)  from  denying  the  access  of  a census  Interviewer 
to  units  In  a building. 

Walsh  presents  the  fieldwork  case  history  of  the  Census  Bureau's  I 

consumer  expenditure  diary  survey.  Households  made  dally  entries  into  j 

an  expense  diary  over  a two  week  period.  The  pretest  in  the  Chicago  | 

area  suggested  cooperation  rate  problems  (around  50  percent).  It  also 
demonstrated  the  Impracticallty  of  placing  diaries  In  households  on 
specific  days.  For  the  first  part  of  the  main  study,  more  Intensive 
interviewer  training  was  given  and  an  experiment  paying  respondents 
conducted.  During  the  first  3 months,  total  noninterview  rate  was  over 
25  percent  with  refusals  at  11  percent  and  a large  percentage  (up  to 
8 percent)  of  households  not  contacted  during  the  6-day  field  periods. 

The  Incentive  treatment  ($5,  $10)  had  small,  positive  but  not  statis- 
tically significant  effects  on  the  Interview  rate  and  was  discontinued  ^ 

part  way  through  the  quarter.  The  usual  exortatlons  to  field  offices  J 

and  Interviews  to  Improve  performance  were  made  and  It  was  hoped  that 
cooperation  would  Improve  on  the  basis  of  Increased  staff  experience 
and  dropping  the  complexities  of  the  remuneration  experiment. 

Second  quarter  rates,  however,  showed  very  little  Improvement. 

The  only  major  change  was  a reduction  In  the  temporarily  absent  (vaca- 
tions, etc.)  rate,  reflecting.  In  part,  the  fact  that  fewer  house- 
holds are  on  vacation  In  the  fall.  Being  a continuous  (2-year)  survey, 
opportunities  for  action  to  Improve  performance  were  available.  Steps 
taken  Included  provision  of  additional  Information  by  the  office  to 
locate  poorly  defined  sample  addresses,  increasing  the  field  staff,  ex- 
tending the  field  period  by  one  day,  requiring  the  Interviewer  to  con- 
tact someone  In  each  sample  household  early  In  the  field  period. 
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reporting  refusals  to  the  supervisor  early  for  further  action,  and  re- 
training interviewers  (emphasizing  refusal  conversion  strategies).  Non- 
response dropped  froih  24  percent  to  18  percent  in  the  next  quarter  with 
the  major  declines  in  the  nonrefusal  (temporarily  absent,  unable  to  con- 
tact, other)  components.  Improvement  continued  over  the  succeeding  15 
months  with  diary  response  rates  around  90  percent  and  refusals  in  the  6- 
7 percent  range.  Central  city  response  rates  averaged  about  88  percent. 

CONCLUSIONS  ABOUT  CORRELATES  OF  RESPONSE  RATES 

I f^  in-person  interview  response  rates  a,xe  not  affected  Impprtantly 

^ 'du’f'  t c*  i r ^ 

by  the  current  social  changes,  ^an  we  how f they -arei^determined^  ' 

From  the  foregoing  discussion,  it  appears  that  seasonality  and  inter- 
view length  don't  have  the  uniformly  strong,  negative  effects  that  some 
suspect.  Hypothesized  positive  forces  such  as  Census  Bureau  auspices, 
using  advance  letters,  and  offering  pa}nDent  aren't  as  powerful  as  we  ' •> 
might  hope.  Callback  strategies  can  account  for  a meaningful  amount  of 
variance  and  respondent  rules  have  some  effect  on  rates  , (e.g.,  1-6  per- 
cent)'hnd  on  costs. (e.g. , a household  respondent  rule  can  save  as  much 
'«<' 

as  17  percent  over  a complete  self-response  rule). 

Interorganizatlonal  differences  are  large,  and  not  attributable  en- 
tirely to  differences  on  the  above  dimensions.  ^Three  additional  dimen- 
sions may  be  responsible  for  the  relative  success  of  the  Census  Bureau: 
the  long  term  nature  of  the  studies  it  undertakes  (creating  the  potential 
for  improvement  over  time),  things  done  by  the  regional  office  to  facili- 
tate fieldwork,  and  the  extensive  quality  control  activities  which  moni- 
tor a wide  range  of  Important  performance  variables  for  individual  inter- 
viewers and  provide  both  immediate  reinforcement  (positive  and  negative) 
and  corrective  action  (e.g.,  retraining)  as  appropriate.  These  are  appli- 
cations of  the  most  powerful  principles  offered  by  psychological  theories 
of  motivation  and  performance.  While  it  will  be  much  harder  for  nonfed- 
eral  survey  organizations  to  apply  these  principles,  the  Investment  may 
have  a substantial  payoff. 
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